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Abstract 


Complex-valued expression models have been widely used in the applica- 
tion of intelligent decision systems. However, there is a lack of entropy to 
measure the uncertain information of the complex-valued probability distribu- 
tion. Therefore, how to reasonably measure the uncertain information of the 
complex-valued probability distribution is a gap to be filled. In this paper, in- 
spired by the Renyi entropy, we propose the Complex-valued Renyi entropy, 
which can measure uncertain information of the complex-valued probability 
distribution under the framework of complex numbers, and is also the first 
time to measure uncertain information in the complex space. The Complex- 
valued Renyi entropy contains the features of the classical Renyi entropy, i.e., 
the Complex-valued Renyi Entropy corresponds to different information func- 
tions with different parameters q. Meanwhile, the Complex-valued Renyi en- 
tropy has some properties, such as non-negativity, monotonicity, etc. Some nu- 
merical examples can demonstrate the flexibilities and reasonableness of the 
Complex-valued Renyi entropy. 
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1. Introduction 


In view of the fact that modeling and measuring uncertain information 
is the basis of expert and artificial intelligence decision making, researcher- 
s have proposed a series of modeling theories, such as probability theory[1], 
Dempster-Shafer theory[2][3], fuzzy set theory[4], rough set theory[5] and their 


extensions|[6] |7| 8]. Accordingly, effective theories for measuring uncertain in- 


formation have also been proposed, such as Shannon entropy|[9], belief entropy [10], 
fuzzy entropy[11], Renyi entropy[12], Tsallis entropy[13] and correlation entropies[11]. 


These theoretical refinements in real-valued space allow for more practical ap- 
plications of expert and artificial intelligence decision making, such as group 
decision-making[14] [15] [16], pattern classification[17| [18], cluster analysis[19| 
[20], reliability analysis[21) [22] and etc[23} [24] [25} [26]. 

In recent years, complex-valued functions have been successively intro- 
duced into uncertain information modeling theory. Ramot et al extended real- 
valued affiliation to complex-valued affiliation and proposed complex-valued 
fuzzy sets[27]. Alkouri and Salleh proposed complex-valued intuitionistic fuzzy 
sets and discussed the distance measure between complex-valued intuitionis- 
tic fuzzy sets[28], and some related theories of complex-valued functions have 
also been proposed based on belief function[29][30]. In addition, some informa- 
tion carriers containing complex-valued signals are emerging, such as image 
signals[31], audio signals[32], physiological signals[33]. However, the curren- 
t uncertain information measurement methods in the real space space cannot 
reasonably measure the uncertain information of these complex value theories, 
further limiting the practical application of complex value theories in many 
fields. Therefore, proposing some reasonable uncertain information measures 
in the complex-valued framework is an urgent problem to be addressed. 

In this paper, inspired by the Renyi entropy[12], we propose a new entropy 


for measuring uncertain information in the complex-valued framework, name- 
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ly the Complex-valued Renyi entropy (CRE). CRE is a generalization of the 
classical Renyi entropy in complex-valued spaces. With different parameters 
a, CRE can be transformed into different information functions, and CRE also 
has some properties, therefore, CRE has a high compatibility, which is proved 
by some numerical examples. Moreover, several numerical examples explain 
the reasonableness of CRE. 

The remainder of the work is organized as follows. Section 2 introduces the 
basics of Renyi entropy. The Complex-valued Renyi entropy is presented in 
Section 3. Section 4 proves the compatibility and reasonableness of Complex- 


valued Renyi entropy. The work is summarized in Section 5. 


2. Preliminaries 


In the section, the basic knowledge of Renyi entropy is introduced. In 1970, 
Renyi proposed the q — order generalized entropy in phase space, called Renyi 
entropy, which is also is a common generalized entropy, and detailed defini- 
tions are as follows:[12] 

Definition 2.1 (Renyi entropy) 
Suppose that p; is the probability of falling in the j — th phase frame system 
state, N is the number of phase frames, and satisfied that BAe 1P; = 1, then 


Renyi entropy is described by the following form. 


1 


R = 
q 1-4 


N 
logs }_ (p;)" (1) 
j=l 


Obviously, the Renyi entropy has some properties in measuring the uncer- 
tainty of the probability distribution, defined as follows: 
Definition 2.2 (The properties of Renyi entropy) 

P.1: Non-negativity, i.e., Rg > 0. 

P.2: Monotonically decreasing. 


P.3: Convexity, i.e., if and only if 0 < q < 1, Rj, is concave function. 
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Renyi entropy can be transferred to other information functions as a changes, 
as described in detail below. 

Shannon entropy: when a = 1, Renyi entropy degenerates to the Shannon 
entropy, that is to say, Ry = ye 1 Pjlog2pj; 

Hartley entropy: when « — 0, then Ry_,9 = log2N; 

Collision entropy: when « = 2, then R? = —logo yy (pj) = —logoP(X = 
Y), where X and Y are independently and identically distributed; 


3. The Complex-valued Renyi entropy complex-valued probability distribu- 


tion 


In this section, we propose the Complex-valued Renyi entropy (CRE) to 
measuring uncertain information in the complex-valued space, it can be con- 
verted to other information functions, being defined as follows: 


Definition 2.2 (Complex-valued Renyi entropy) 


Suppose there is a complex-valued probability distribution P = {f1, P2: +- , Bir: 


where fj = pje” ™i and satisfied that };—4 (pj) = 1,6; € [0,1]. The uncertain- 


ty of the complex-valued probability distribution is measured by the following 


format. 
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where p j is the conjugate of fj. Next, we discuss the information function 


corresponding to Complex-valued Renyi entropy when a changes. 


e when « = 1, CRE degraded to Shannon entropy of complex-valued frame- 
work. 
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Therefore, we describe Ř4 as follows: 


noo, iD" pip; 270; 
=2 (ż Pipi log2pj i (3) 
j=1 


Ř = 
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e when a — 0, CRE degraded to Hartley entropy of complex-valued frame- 


75 work. 
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NO 
= zye} (P 5) =logN (4) 


e when a = 2, CRE degraded to Collision entropy of complex-valued frame- 


work. 


I llog» L ( i ii’) = log, (P; ii’) (6) 


80 Next, we discuss the properties of the CRE. 
P.1: Non-negativity, i.e., R, > 0. 


Proof: 


Consider q > 1, and 0 < BiB; < 1, then Li (Bey < Liz BiB; =f 
Further, logy 5, (vip) < 0, finally, Ry > 0. 
= Wheng <1, Ei ii)" > El; pipj = 1. Then, logs Dy (Gia >0, 
and R4 = 0. 
When q = 1, CRE degenerates to R,, and R, > 0, that is to say, Ry > 0. 
P.2: Monotonically decreasing, i.e., R; decreases as q increases. 
Proof: 


By taking the derivative of Ry with respect to parameter q, we can obtain: 
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From Jensen’s inequality, it follows that if f (x) is a concave function, then 
E(f (X)) < f(E(X)), and if f (x) is a convex function, then E (f (X)) > 


f (E (X)), and Ln is a concave function, then 
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Thus, R, decreases as q increases. 

P.3: Convexity, i.e., if and only if0 < q < 1, Ry is concave function. 

Proof: 

Consider when 0 < q < 1, n(x) and x1 are both concave functions, then 
y 4; : 
R = T1082 EGA (Pi) is also a concave functions. 


1 
iZ! pipj 270; 
When q = 1,— | Dia Bip; logop; — mage) and ||||, are the concave 


functions, thus, R4 is also a concave function. 
When q > 1, In(x) is a concave function, but x7 is a convex function, then 
R, is neither a convex function nor a concave function. 


In summary, if and only if 0 < q < 1, Ry is concave function. 


4. Numerical examples 


In this section, the flexibilities and reasonableness of CRE for uncertain 
information measures is explained through several numerical examples in a 
complex-valued framework. 

Example.1 Suppose there exists a set consisting of elementary events, denot- 
ed as E = {e,€,e3}, and the complex-valued probability distribution is de- 


scribed in E as follows: 
f= e 0,0} 


With the above equation, we can get to the uncertainty information measure- 
ment results corresponding to parameters q, as shown in Table 1. As can be 
seen in Table 1, for any q, the measurement of the probability distribution Pis 
0, which is an intuitive result, because the probability of occurrence of event e1 


is 1. 


Example.2 There exists a complex-valued probability distribution P correspond- 


Table 1: The measurement of uncertain information in Example 1. 


Ry Ry=o Rq=0.5 gai Rq=2 Rq=8 
Entropy 0 0 0 0 0 


ing to the set of fundamental events E = {e1, e2, e3, e4}, noted as follows: 


pe { 0.20293 \/9 e205 Y04274, E | 


Table 2: The measurement of uncertain information in Example 2. 


Ry Rg=0 Rg=05 Ryo Ry=2 Ry=8 
Entropy 2 1.9175 2.1391 1.7370 1.4904 


The results of CRE measures on P are shown in Table 2. It can be seen from 


Table 2, that different values of p correspond to different results of measure, 


for example, when q = 0, Ro = 2,andq = 0.5, Ros = 1.9175, Obviously, when 


ws q € (0,1), then Ry is monotonically decreasing. When g = 1, Ry = 2.1391, 


which characterizes the uncertainty of amplitude and phase angle, and also Rg 


has more uncertainty than KŘ, for P. 


Example.3 Suppose there is a complex-valued probability distribution P = 
fv 0.4e?704, 0.3e0, y T corresponding to the set of elementary 


uo events E. when q varies, the uncertainty measure of CRE for this probability 


distribution is shown in Figure 1. From Figure 1, we can see that Ra is larger 


than 0 when q changes from 0 to 100. Moreover, it proves that Ry has mono- 


tonic decreasing property. 
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Figure 1: Uncertainty measurement results Figure 2: Uncertainty measurement results 
when q varies when |E| varies 
us Example.4 Suppose there exists a complex-valued probability distribution P in 


the set of basic events E, the distribution satisfies pj = pert, |E| is the 
number of events, and its variation is shown in Table 3. The uncertainty mea- 
sure for the complex-valued probability distribution P based on CRE is shown 
in Figure 2. As can be seen from the figure, the uncertainty of this complex- 

no valued distribution increases continuously as the basic events increase. When 
|E| = 32, for any q, R, is the largest. This example demonstrates that CRE can 
effectively measure the uncertainty of the complex-valued probability distri- 
bution under the condition that the number of basic events changes. 


Example.5 There is a complex-valued probability distribution P = {e705 Bei2702, 


Table 3: The set of basic events E in Example 4. 


|E] E 

1 {ea} 

2 {e1,e2} 

3 {e1, €2,23} 

j {e1,€2,e3--+ ,e;} 

32 {€1,€2,€3 ++ €j e32} 


ws /1—a2 — prea in E = {e1,e2,e3}, where the relationship between « and 
b is shown in Figure 3(a). We can see from Figure 3(a) that a and f satisfy 


O0<a<1,0<B<land0O< a? + B2 < 1. Figure 3(b) is the measurement 
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Figure 3: The uncertainty measurements based on CRE under different param- 
eters p 
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of P based on CRE when q = 0, which shows that Ry=0 does not vary with 
& and $f. This is reasonable. It is know by Equation (4) that the factor affect- 
ing Ry=0 is the number of basic events. When q = 0.5, the measurement of 
P based on CRE is shown in Figure 3(c). From the figure, we can know that 
Ry=05 < Ry=0, regardless of the variation of a and $. When q > 1, Ro 
measures the uncertainty between phase angle and amplitude in P, as shown 
in Figure 3(d). Figure 3(d) is asymmetric, which is intuitive. In P, the phase 
angles of the three fundamental events are not equal leading to measurements 
that are also not symmetric. Figure 3(e) and Figure 3(f) show the uncertainty 
of CRE measurement in Ê when q = 2 and q = 8, respectively, from which it 
can be seen that in the same coordinate system, Ry=2 > Roce This example 
demonstrates the reasonable results that can be obtained from the CRE when 


the support of a proposition changes. 


5. Conclusion 


In this paper, given that current methods of uncertainty measurement can- 
not effectively measure the uncertainty of complex-valued probability distri- 
butions, inspired by the Renyi entropy, we propose the Complex-valued Renyi 
entropy. The Complex-valued Renyi entropy provides an effective measure of 
uncertainty of probability distributions in a complex-valued framework. We 
discuss the effect of the change of the parameter q in the Complex-valued Reny- 
i entropy, and we also discuss some properties of the Complex-valued Renyi 
entropy, and further, verify the Complex-valued Renyi entropy can effective- 
ly and reasonably measure the uncertainty of the complex-valued probabili- 
ty distribution by numerical examples when the propositional support degree 
and the number of underlying events change. In addition, there are two fu- 
ture research directions for this work, firstly, first,to study the meaning of the 
parameter q representation in CRE under the framework of complex-valued 


probability distribution. Second, some related concepts of the Complex-valued 
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Renyi entropy, such as divergence and etc, are discussed to further explain its 


physical meaning and apply it to engineering practice. 
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